-
-
Notifications
You must be signed in to change notification settings - Fork 400
[Feature] 模型选择qwen3时,有一个enable_thinking参数,希望添加自定义参数,模型默认思考会导致翻译时间过长 #1164
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
支持,现在只能在prompt前面加/no_think来消除think里面的内容,但是删除不了 |
qwen3,是在post请求里多了一个参数来控制思考的,和prompt这种不太一样吧 |
确实是,但是prompt添加了think部分确实是没内容了,但是这个办法不如添加参数来关闭思考 |
尝试添加了Thinking设置,但是我这边没办法测试,@leoz9 可以帮忙测试下吗,可行的话我再开pr |
自定义GPT里没看到自定义thinking的地方 |
我这边试了下,还不太行,我再看看手册 |
根据官方文档, 并且因为是通用LLM服务,在插件设置层面添加该选项,有可能给其他使用类OpenAI服务的users增加额外无效checkbox,综合来看,在prompt中手动添加 |
和流输出一样加一个if选项是不是开启这个参数?,或者可以添加一个自定义参数的位置,如果有key,则激活这个函数,加到post请求里,因为后期可能不同提供方有不同的参数,可以一劳永逸
…On Thu, May 1, 2025 at 10:05 Mi Ramon ***@***.***> wrote:
*ramonmi* left a comment (windingwind/zotero-pdf-translate#1164)
<#1164 (comment)>
支持,现在只能在prompt前面加/no_think来消除think里面的内容,但是删除不了
根据官方文档 <https://qwenlm.github.io/blog/qwen3/#advanced-usages>,/think和
/no_think允许用户在enable_thinking=True的情况下,动态调整是否启用思考模式。因此,在prompt中添加no_think
和设置enable_thinking=False的效果应当是等同的,实测添加后翻译速度明显加快了,且没有展示思考过程。
并且因为是通用LLM服务,在插件设置层面添加该选项,有可能给其他使用类OpenAI服务的users增加额外无效checkbox,综合来看,在prompt中手动添加
no_think已经够用?
—
Reply to this email directly, view it on GitHub
<#1164 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ALUZBJQIXRLFG7BUHESFJ5324F6PDAVCNFSM6AAAAAB4E4MBPCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDQNBTHEYTONJVGA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
如果能够过滤<think>标签就完美了,现在还得手动删一下 |
没错 |
请问prompt具体是怎么设置的呢?temp多少,我这里用着customGPT没有输出标签 |
think标签是默认带有的,qwen发布的博客说这是为了兼容性,所以即使使用/no_think也会输出一个空的“<think></think>”标签。所以需要客户端/前端对不需要输出think的场景进行过滤 |
Is there an existing issue for this?
Environment
Describe the feature request
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Why do you need this feature?
A clear and concise description of why you need this feature.
Describe the solution you'd like
The solution you'd like
A clear and concise description of what you want to happen.
Alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Anything else?
No response
The text was updated successfully, but these errors were encountered: